1 link tagged with all of: ai safety + crisis intervention + mentalhealthbench + evaluation + healthcare
Click any tag below to further narrow down your results
Links
OpenAI created MentalHealthBench, an open-source benchmark developed with 80+ licensed mental health experts to measure how well AI systems handle mental health conversations. The benchmark tests whether AI responds safely, preserves user autonomy, and appropriately directs people to professional help.
- Built with 80+ licensed mental health professionals across 22 countries speaking 19 languages, covering nearly 20 subspecialties
- Evaluates AI on specific behaviors: safety, seeking context, preserving user agency, and providing actionable guidance
- Covers the full spectrum from everyday emotional conversations to high-acuity scenarios requiring crisis intervention
- Results show steady improvement in frontier models, though the benchmark acknowledges AI is not a substitute for actual therapy